Papers with checkpoint selection strategies
Revisiting Checkpoint Averaging for Neural Machine Translation (2022.findings-aacl)
Copied to clipboard
| Challenge: | Checkpoint averaging is a simple and effective method to boost the performance of converged neural machine translation models. |
| Approach: | They propose to use checkpoint averaging to increase model performance . they also propose to calculate weighted average instead of simple mean . |
| Outcome: | The proposed method is widely adopted in neural machine translation research. |